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PRELIMINARY AMENDMENT 

Please amend the above-identified application as follows: 
IN THE SPECIFICATION: 
At page 1 , line 1 , kindly add: 

-CROSS-REFERENCE TO RELATED APPLICATIONS: 

This application is a continuation of United States patent application serial 
no. 08/821,436 entitled "SYSTEM AND METHOD FOR SUPPLYING 
SUPPLEMENTAL AUDIO INFORMATION FOR BROADCAST TELEVISION 
PROGRAMS filed March 21 , 1997. -- 

IN THE CLAIMS: 

Kindly cancel claims 3-9, 11,13, 16-31 , 37, 40-41 , 45-48 without prejudice. 

REMARKS 

Upon entry of this amendment, claims 1-2, 10-12, 14-15, 32-36, 38-39, and 
42- 44 will be pending in this case. Claims 3-9, 11, 13, 16-31, 37, 40-41, and 45-48 
have been cancelled herein. Applicants respectfully request consideration of claims 1- 
2, 10-12, 14-15, 32-36, 38-39, and 42-44. 
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If the Examiner has any questions regarding the application or any 
suggestions for expediting allowance of the present application, the Examiner is 
cordially requested to contact Steven Santisi at telephone number (203) 461-7127 or 
via electronic mail at Steven.Santisi@WalkerDigital.com. 



Septembers, 2000 
Date 



Respectfully submitted, 




Steven M. Santisi 
Attorney for Applicants 
Registration No. 40,157 
Walker Digital Corporation 
Five High Ridge Park 
Stamford, CT 06905-1325 
(203) 461-7127 /phone 
(203) 595-8266 / fax 
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SYSTEM AND METHOD FOR SUPPLYING SUPPLEMENTAL AUDIO 
INFORMATION FOR BROADCAST TELEVISION PROGRAMS 

BACKGROUND OF THE INVENTION 

This invention relates to the field of broadcast 
television programs. More particularly, the present 
invention provides a system and a method for television 
viewers to receive additional dialog and information, 
via a selected interface, related to characters on a 
specific broadcast television program. 

Many television (TV) programs, such as daytime soap 
operas and situation comedies, are regularly watched by 
large audiences. Considering the growing number of TV 
sets in homes and the amount of time the average person 
spends watching TV, the size of the audience is expected 
to increase over time. Correspondingly, programs need to 
change and evolve to suit the ever-more diverse tastes 
and interests of this expanding audience. 

Television networks, cable companies and independent TV 
program providers offer a myriad of TV program categories 
to capture the interest of viewers. These TV program 
categories include, for example, game shows, talk shows, 
situation comedies, sporting events, and soap operas. 
The ultimate goal is to provide interesting programming, 
in order to capture a large segment of the viewing 
audience . 

One popular category of TV programming is the daytime 
soap opera. This type of program revolves around the 
day-to-day lives of characters featured within the 
program. A plot or story-line for a typical soap opera 
can span several episodes, possibly an entire TV season. 



Each episode continues and develops the story-line 
further, and also develops the personalities of 
characters within the soap opera in an ever-expanding and 
detailed manner. 

Soap operas, as well as other TV programs, often develop 
a core group of passionate and dedicated viewers. Many 
viewers religiously watch every episode of their favorite 
TV programs loathing to miss even a single episode. 

With these viewers in mind, several magazines on the 
market summarize daily or weekly episodes of television 
programs for people who may have missed a particular 
episode. There are also 900 telephone numbers available 
that offer similar services for a fee. These are just 
two areas in which peripheral services have developed in 
response to TV viewer's demand. 

Moreover, many TV viewers are extremely involved in their 
favorite TV program 1 s story-line and characters. The 
writers of TV programs must weave complex and interesting 
plots to maintain the viewer's loyalty and interest in 
the program. In most instances, multi-faceted and 
we 11 -developed characters are essential to the popularity 
(and longevity) of the program. Thus, a typical script 
for a TV program may be written, revised and edited 
numerous times to ensure that the result is interesting, 
realistic, believable or humorous. 

Writers and producers spend a great deal of time 
developing characters and story-lines for TV programs 
that ultimately are not used in the broadcast version of 
the TV program. Many times several scripts, each with 
different plot twists and dialogue, are developed for 
each TV program episode. This is occasionally done to 
preserve the secrecy of the final broadcast episode. 
However, more often than not, these changes and alternate 
scripts are never broadcasted. Thus, the TV program 
producers and developers have no outlet to display this 
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additional work-product (or by-product, as the case may 
be) to the viewing public. 

To a certain extent, dedicated viewers of, for example, a 
soap opera, live vicariously through the trials and 
tribulations of the TV characters. Any additional 
information on their favorite TV program is of interest 
to these viewers, particularly, the thoughts, feelings 
and motivations that help define the TV characters. 



However, the typical TV program format makes it difficult 

to develop the thoughts and feelings for a TV character 
:ji in great detail. The story-line in a TV program must 

;i! flow in a relatively quick and fluid manner. Unlike a 

jit 15 novel, where an author can, between exchanges of 

iJ! dialogue, devote extensive time to a given character's 

; g thoughts, motivations, and considerations, the dialogue 

in TV programs must flow in a real-time manner. In many 
;!! situations, this means that the writers must briefly 

summarize the thoughts or motivations of a character to 
j j;f keep the action flowing smoothly. 

For example, a soap opera might have the lead female 
character saying to the lead male character: "I am going 

25 to Ne ™ York for lunch. Would you like to join me?" 

However, her thoughts, which are not being broadcasted, 
may have her contemplating several devious things she is 
considering doing while in New York. These devious 
machinations may or may not occur depending upon the road 

30 the writers decide to follow for the story-line. 

A wealth of non-broadcast material (from story-line 
changes and revisions) could be created and used to 
supplement the audio tracks of TV programs. In the 
35 example discussed above, a parallel audio track could be 

used to provide the additional thoughts of the lead 
female character to listeners who are simultaneously 
watching the TV broadcast. 



In this regard, modern stereo televisions can receive a 
secondary audio channel (SAP) . SAP technology has been 
used to provide descriptive video (DVS) , which prints 
words on the television screen describing the action for 
the deaf. SAP has also been used to provide non-English 
audio tracks for the TV programs or sporting events, as 
well as a running commentary on TV movies. Some radio 
stations also broadcast audio tracks of live events (e.g. 
sporting events) or TV programs. 

However, these conventional simulcasting systems provide 
everyone using the system with the same audio track; 
i.e., all viewers (or listeners) using these systems 
receive the same information. There is no way for a TV 
viewer to select individual information, for example, 
additional dialogue or thoughts of a particular character 
on a TV soap opera program. Moreover, these systems are 
typically provided for a monthly or annual service fee or 
are provided at no cost, because charging on a per-TV 
program or per-use basis is administratively difficult to 
process, or not possible at all. 

Other systems have been developed using community antenna 
television facilities (CATV) that allow subscribers to 
interactively request still-television video frames with 
an accompanying audio message. However, the TV video and 
accompanying audio message provided by these systems are 
not related to, or synchronized to, broadcast TV 
programs . 

Phone services (e.g. chat rooms and conference calling 
systems) also exist that allow callers to dial-in and 
listen to pre-recorded audio messages or even listen to 
live events in progress. When a caller uses a dial in 
service to listen to a sporting event, for example, which 
is being simultaneously broadcasted on TV, the radio 
audio track replaces the TV audio track. Thus, these 
services are not synchronized to the TV program's audio 



track and are not designed to supplement the dialogue for 
the TV program. 

Until now, producers and broadcasters of TV programs have 
not been able to benefit from non-broadcast material 
developed in relation to a TV program's story-line or 
characters. Therefore, synchronized audio tracks 
providing supplemental information for TV programs', have 
not been created. This supplemental audio information 
would be of great interest to devoted fans of TV 
programs. In addition, TV program broadcasters would 
have an alternative venue to bolster their TV program's 
characters, thereby creating even greater interest in the 
particular TV program. Accordingly, there is a need for 
a system that solves the above described problems . In 
particular, a system that permits TV producers to provide 
additional valuable entertainment content to interested 
viewers . 



SUMMARY OF THE INVENTION 

The present invention solves the foregoing deficiencies 
by providing a system and a method for enabling 
television program viewers to receive supplemental 
information related to the television program. 

The present invention advantageously enables television 
program viewers to select supplemental information 
related to particular characters in a television program 
through a telephone network interface. The selected 
supplemental information is then received by the viewer 
via an appropriate interface. 

In particular, one aspect of the present invention is 
directed to a method of supplying supplemental audio 
information that is synchronized to a broadcast 
television program so that the supplemental audio 



information is not in conflict with the audio component 
of the television program. This method includes 
providing selection and synchronization information 
through the broadcast television program, and supplying 
the supplemental audio information in accordance 
therewith. 

Other aspects of the present invention are described 
below. 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram overview of one system 
constructed in accordance with the present invention. 

FIG. 2 is a block diagram of the service controller of 
FIG. 1. 

FIG. 3 is a table depicting the network database within 
the service controller of FIG. 2. 

FIG. 4 is a table depicting the program database within 
the service controller of FIG. 2. 

FIG. 5 is a table depicting the character database within 
the service controller of FIG. 2. 

FIG. 6 is a table depicting the recording database within 
the service controller of FIG. 2. 

FIG. 7 is a table depicting the billing database within 
the service controller of FIG. 2. 

FIG. 8 is a flow chart of the operation of the system. 

FIGS. 9a and 9b are fl ow charts of the operation of the 
service controller. 
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FIGS. 10a and 10b are flow charts depicting how the 
service controller processes information received from 
the IVRU. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In a preferred embodiment of the present invention, 
writers for a TV program write supplemental dialogue for 
specific characters featured in the TV program. This 
supplemental dialogue consists of "thoughts" and 
O " comment s" not spoken aloud during the broadcast version 

i: of the TV program. For example, these thoughts could 

:| 5 include a hidden agenda, a character's true feelings 

J ] toward another character, or other motivational factors 

lj driving a character's actions. While many devoted fans 

are interested in this type of information, it is not 
5 easily conveyed to the viewing audience during the 

real-time exchange of dialogue between characters on the 
TV program. 



l2o 



In the present invention, audio recordings of these 
thoughts and comments are recorded using actors from the 
25 TV program. Of course, voice-doubles for the actors 

could also be used to make the audio recordings. The 
audio recordings are then edited and synchronized to the 
broadcast TV program. This process ensures that the 
additional thoughts and comments do not overlap the 
dialogue being spoken on the broadcast version audio 
track. These thoughts and comments are interspersed 
during the non-speaking periods and other appropriate 
periods in the TV program so that they can be listened to 
simultaneously with the TV program without conflict. 



30 



35 



In alternative embodiments, the supplemental audio 
information can be used for other purposes. Several 
examples of other types of supplemental audio information 



for TV programs include: adult content and themes not 
available on the regular program, and multiple audio 
tracks of the same TV program, which provide different 
sets of audio information each time the TV program is 
viewed (and listened to) . For example, each viewing could 
offer the hidden thoughts of a different character, or 
offer the viewer clues (e.g., hints concerning 
alternative actions or events that may or may not occur) . 
This may give the viewer the sense that he is somehow 
participating in the show. Supplemental audio information 
can also be used to provide additional content, also 
referred to as "hyper-content," for news-type programs, 
consisting of information not included in the broadcast 
(e.g. an unabridged news report) . 

Traditional methods of broadcasting audio tracks, such as 
SAP or radio, are not suitable for the present 
application. The supplemental audio information must be 
made available only to customers requesting the service 
(i.e. not broadcasted to the world). In addition, there 
may be multiple versions of supplemental audio 
information for a particular TV program, so that 
different customers can choose different supplemental 
audio information for the same TV program, or watch the 
same TV program multiple times with different 
supplemental audio information each time. The 
supplemental audio information is synchronized with the 
audio track of the broadcast TV program - enhancing the 
audio track rather than merely replacing it. 

FIG. 1 shows an overall system block diagram of a 
preferred embodiment of the present invention. In this 
embodiment, a customer receives service information 31, 
which is displayed discretely during the broadcast of a 
television program 30. The service information 31 
comprises a 900 telephone number and a program 
identification code. The program identification code is 
a ten digit alphanumeric code comprising selection 



information and synchronization information (none of 
which are shown) . The service information 31 is used by 
the customer to request specific supplemental audio 
information related to the television program 30, as 
discussed below. 



It is understood that the television program 3 0 is one of 
many television programs that are broadcasted or 
transmitted to the public. The television program 30 is 
received and displayed by conventional electronic 
equipment (i.e. a television set, not shown) located in 
close proximity to the customer. The electronic display 
equipment may receive the television program 3 0 through 
an antenna adapted to receive TV signals from a TV 
broadcast station, from a satellite transponder, a trunk 
cable from a CATV (i.e. cable TV) system, or from any 
other suitable transmission means. 

The service information 31 is recorded on the same 
recording medium as the television program 30. For 
example, a television program can be recorded and then 
the service information 31 can be added during editing of 
the recorded television program. The service information 
31 can also be added at the time of broadcasting the 
television program 30. 

It is also understood that the service information 31 
would be displayed even if the television program 3 0 is 
recorded on a recorded medium and played-back by the 
customer. While one customer is depicted in FIG. 1 
receiving the service information 31 from the television 
program 30, it is understood that the television program 
30 is broadcasted to any number of customers 
simultaneously. 

As illustrated in FIG 1., the customer, by utilizing his 
telephone (not shown) , communicates through a public 
switch telephone network 10 (PSTN) and an interactive 
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voice response unit, IVRU 12, to a service controller 20. 
The customer provides the selection information and 
synchronization information, to the service controller 
20. In response, the service controller 20 sends the 
supplemental audio information to the customer. The 
communication process via the telephone is discussed in 
detail below. 

FIG. 2 is a block diagram of the preferred service 
controller 20. The service controller 20 includes a CPU 
21 which performs the processing functions. The service 
controller 2 0 also includes a read only memory 22 (ROM) 
and a random access memory 23 (RAM) . The ROM 22 is used 
to store at least some of the program instructions that 
are to be executed by the CPU 21, such as portions of the 
operating system or basic input-output system (BIOS) , and 
the RAM 23 is used for temporary storage of data. A 
clock circuit 24 provides a clock signal which is 
required by the CPU 21. 

The CPU 21 can also store information to, and read 
information from, a data storage device 26. The data 
storage device 2 6 includes a network database 2 6a, a 
program database 26b, a character database 26c, a 
recording database 26d, and a billing database 26e. 
These databases are described below. In addition, the 
data storage device 26 includes instructions which can be 
read by and executed by the CPU 21, thereby enabling the 
CPU 21 to process requests. While FIG. 2 depicts 
separate databases, a single database that incorporates 
the functions of the databases mentioned above can also 
be used. Additional databases may be added as needed to 
store a variety of other information that may be required 
for other purposes. 

The data storage device 26 also contains all the 
supplemental audio information recorded for each 
character, the supplemental audio archive 26f as 
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described in more detail subsequently. Any of a wide 
variety of storage mediums are suitable for this purpose, 
including, for example, audio cassettes, digital audio 
tapes (DAT), laser discs, and the like. 

In an alternative embodiment, the service controller 2 0 
may have an external interface for inputting supplemental 
information, either live or pre-recorded. This 
supplemental information may include, for example, live 
audio information or even video information coupled with 
an audio component. The live audio information can 
include, for example, alternative color commentary for 
sporting events (e.g., Howard Stern, a popular radio disc 
jockey, providing supplemental color commentary on the 
Superbowl), or even specific athletes wearing 
microphones/transmitters during the sporting contest 
(e.g., a customer could dial 1-900-RANGERS to hear what 
their favorite hockey player is saying during the game) . 

The service controller 2 0 also includes a communication 
port 25 connected to an inter-active voice response unit 
interface 11. The communication port 25 enables the CPU 
21 to communicate with external devices. An IVRU 12, as 
shown in FIG. 1, is linked to the service controller 2 0 
via the IVRU interface 11. The IVRU 12 is connected to 
the PSTN 10. 



A plurality of telephone trunks (not shown) terminate at 
the IVRU 12 to allow multiple callers (i.e., customers) 
to call the IVRU 12 simultaneously. These telephone 
trunks may be analog or digital. The IVRU 12 may also 
terminate North American standard digital signal one 
(1.544 Mb/sec) facilities in a manner similar to a 
private-branch exchange (PBX) . 

The IVRU 12 allows the customer to communicate with the 
service controller 2 0 using his or her telephone (not 
shown) . Voice command prompts guide the customer through 
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various menu options allowing the customer to communicate 
and obtain information from the service controller 20. 

FIG. 3 is a pictorial representation depicting the 
information stored in the network database 2 6a. The 
network database 2 6a comprises information related to 
each TV program provider or distributor associated with 
the present invention. The network database 26a includes 
a network name field Fl, a network identification number 
field F2, and a number of participating programs field 
F3 . The network identification number field F2 is a 
unique two digit code corresponding to each network or TV 
program provider. While only four records R1-R4 for four 
networks are depicted in FIG. 3, any number of records 
may be stored. It is also understood that independent 
and syndicated broadcast program providers may also be 
included in this database. 

FIG. 4 is a pictorial representation of the content of 
the program database 2 6b. The program database 2 6b 
comprises information related to each television program 
3 0 for which supplemental information is available. The 
program database 2 6b includes a program name field F4, a 
program identification number field F5 , a network 
identification number field F6 (corresponding to field F2 
of the network database 26a), a broadcast times field F7, 
a participating characters field F8, and a phone number 
field F9. The program identification number field F5 is 
a unique four digit code corresponding to each TV 
program. The participating characters field F8 contains 
the names of various characters for which supplemental 
audio information is available. The phone number field 
F9 includes a unique telephone number associated with 
each television program 30. This unique telephone number 
is dialed by the customer to request supplemental audio 
information related to that particular television program 
30. Other fields are described in greater detail below. 
Any number of records R5 may be stored in this database. 
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FIG. 5 is a pictorial representation of the layout and 
the information stored in the character database 26c. 
The character database 26c comprises information related 
to specific characters for which supplemental audio 
information is available. The character database 2 6c 
includes a character name field F10, a character number 
field Fll, and a program identification number field F12 
(corresponding to field F5 in database 2 6b) . While only 
four records R6-R9 for four characters are depicted in 
FIG. 5, any number of records may be stored. 

FIG. 6 is a pictorial representation of the layout of the 
recording database 26d. The recording database 26d 
comprises information related to the supplemental audio 
information which may be provided to a particular 
customer. The recording database 2 6d includes a program 
identification number field F13 (corresponding to field 
F5 in the program database 2 6b) , an episode number field 
F14, a character number field F15 (corresponding to field 
Fll in the character database 2 6c) , a time-code received 
field F16, a recording number field F17, and a telephone 
number dialed field F18. The time-code received field 
F16 is discussed in more detail below. Any number of 
records RIO may be stored in this database. 

FIG. 7 is a pictorial representation of the layout and 
the information stored in the billing database 2 6e. The 
billing database 26e includes a caller telephone number 
field F19, a 900 number dialed field F20, a program 
identification number field F21 (corresponding to field 
F5 in the program database 26b) , a character number field 
F22 (corresponding to field Fll in the character database 
26c), a recording number field F23 (corresponding to 
field F17 in the recording database 26d) , a total time 
expired field F24, a final dollar amount F25, and a 
caller verified rate field F26. While only four records 
R11-R14 are depicted in FIG. 7 , any number of records may 
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be stored. To conserve storage space on the data storage 
device 26, records may be transferred to a different 
storage device or deleted after some predetermined time 
interval or after a predetermined event such as receipt 
of payment from the customer. 



It is understood that the records and information stored 
within all the databases may be updated as needed, for 
example, when a new character is added or a^ show is 
deleted from the databases. This is accomplished through 
a maintenance terminal 4 0 operatively connected to the 
service controller 20. 

FIG. 8 is a flow chart depicting an exemplary operation 
of the preferred embodiment of the present invention from 
the point of view of a customer. The process starts when 
the customer sees the service information 31 displayed on 
a TV screen while viewing the television program 3 0 in 
step SI. 



As mentioned above, the service information 31 comprises 
three components: a 900 telephone number, selection 
information and synchronization information, as described 
in detail below. In this embodiment, one general 900 
telephone number is provided for all the TV programs, and 
the selection information, is used to select particular 
supplemental information for the television program 30. 

The synchronization information comprises a running 
time-code that is updated on the TV screen at 
predetermined intervals. The preferred interval for 
updating the time-code is every second. However, other 
intervals can also be used, for example, the time-code 
could be updated at specific milestones during the 
television program 30. 

The time-code ensures that the supplemental audio 
information is properly synchronized to the TV program 



30. It also allows the supplemental audio information to 
be synchronized to a TV program that has been taped using 
a video cassette recorder (VCR) . Thus, the customer may 
listen to supplemental audio information for a TV program 
while it is being broadcast, or during a time-shifted 
playback of a previously broadcast TV program. 

An example of the time-code in the preferred embodiment 
is the number "3 6 00." In this case, the time-code 
indicates that the supplemental audio information should 
be offset by sixty minutes and zero seconds (i.e., 3600 
seconds, which is exactly sixty minutes) . Of course, 
time-codes greater than four digits can also be used if 
greater offsets are required. 

As understood by one of ordinary skill in the art of 
telephony, 900 telephone numbers provide services (e.g. 
weather or sports information) for which the caller is 
charged a pre-determined rate per minute of use. In a 
similar manner, the customer is charged for supplemental 
audio information provided. 

In an alternative embodiment, a unique 900 telephone 
number for each television program 3 0 may be used, 
instead of one general 900 telephone number. In such an 
embodiment, the service controller 2 0 determines which 
television program 3 0 is being viewed by the customer 
based on the unique 900 telephone number dialed. In 
another embodiment, 800 or 888 numbers may also be used. 
In such an embodiment, the customer is prompted for a 
credit card number to pay for the supplemental audio 
information. Arrangements could also be made for 
pre-paid minutes or service credits for particular 
customers . 

By utilizing his or her telephone, the customer 
communicates to the service controller 20 by making a 
conventional telephone call. in step S2 , the customer 
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dials the 900 telephone number, which is provided as part 
of the service information 31, and is connected to the 
service controller 20. After the connection is made, the 
customer is prompted via recorded voice messages to enter 
selection information and synchronization information 
related to the program being viewed. The telephone's 
keypad is used to enter this information. Alternatively, 
voice recognition software within the IVRU 12 could also 
be used to respond to voice commands from the customer. 

After entering the synchronization information consisting 
of the time-code, the customer can optionally adjust the 
entered time-code to ensure a close match with the 
running time-code on the television program 30. In 
particular, recorded messages transmitted from the IVRU 
12 can prompt the customer to adjust the time-code using 
the telephone keypad. For example, the "pound" key can 
be used to increment the value of the time-code, and the 
"star" key to decrement the value of the time-code. 

The customer then listens to a menu listing of 
characters. In step S3, the customer selects which 
character (or group of characters) in the television 
program 3 0 for which he or she desires to receive 
supplemental audio information. Optionally, the customer 
may be provided with additional menu choices_such as the 
option of purchasing supplemental audio information for 
the entire television program 30 or just a portion. 

In step S4, the service controller 20 plays the selected 
supplemental audio information synchronized to the action 
occurring on the television program 30. The supplemental 
audio information is synchronized so that it does not 
overlap with the spoken dialogue of the television 
program 30, but supplements it during appropriate pauses 
or gaps. The customer receives the supplemental audio 
information via the telephone. of course, the customer 
can use a speaker phone or other speaker means to 
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facilitate listening to the supplemental audio 
information . 

In an alternative embodiment, an interface via the 
Internet may also be provided allowing the customer to 
receive the supplemental audio information, as well as 
make the request for the supplemental audio information. 
This Internet interface may also be used to receive 
supplemental video or text information from the service 
controller 20 related to the particular television 
program 3 0 selected by the customer. For example, the 
text of a note handed between two characters on a TV 
program 3 0 could be displayed on a commercially available 
web browser running on a computer connected to the 
Internet . 

The service charges are billed to the customer's periodic 
telephone statement in step S5 . In the customer's 
periodic telephone statement, an itemized listing of the 
charges appear for each supplemental audio information 
received. Of course, the customer may be billed in other 
ways, such as a separate statement for each use. 
Alternatively, instead of a 900 telephone number, an 800 
or 888 telephone number may be provided through which the 
customer would also be prompted to enter a valid credit 
card number to be billed for the service. 

FIGS. 9a and 9b are flow charts of the exemplary 
operation of the service controller 20 after the customer 
dials the 900 telephone number and is connected to the 
service controller 2 0 via the PSTN 10. The steps of the 
process shown in FIGS. 9a and 9b may be implemented in a 
computer program that may be installed at the service 
controller 2 0 from a computer readable medium and then 
stored therein in one or more of the ROM 22, the RAM 23 
and the data storage device 2 6 (shown in FIG. 2) . 

After the incoming call has been received by the service 



controller 20 in step S6, the CPU 21 creates in step S7 a 
new record in the billing database 2 6e (shown in FIG. 2) . 
Stored in the appropriate fields (F19 and F20, 
respectively in FIG. 7) in this new record are the 
caller's telephone number and the 900 telephone number 
dialed by the caller. As understood by one of ordinary 
skill in the art of telephony, the caller's telephone 
number is received from a telephone switch that 
established the connection through the PSTN 10. 

In steps S8-S10, the CPU 21 requests and receives the 
program identification code from the caller via the IVRU 
12 . The program identification code is processed, as 
discussed in detail below, by the service controller 20 
in step Sll. Also in step Sll, the CPU 21 accesses the 
program database 26b and retrieves the list of 
participating characters for the particular television 
program 30. The list is then transmitted to the IVRU 12. 

In step 12, the caller (i.e. the customer) receives a 
recorded voice message from the IVRU 12 comprising a menu 
of the participating characters to choose from. The 
caller's character selection is captured and transmitted 
to the CPU 21 by the IVRU 12 in step S13 . This 
information is processed by the service controller 20 
which then accesses the recording database 2 6d. 

The recording database 26d contains identifying 
information for all the supplemental audio information 
stored within the data storage device 26 or accessible by 
the CPU 21. Based on the program identification code and 
character selection entered by the caller, the CPU 21 in 
step S15 obtains the appropriate supplemental audio 
information stored in the data storage device 2 6 or 
accessible by the CPU 21. 

Before the supplemental audio information is 
communicated, the caller is prompted to confirm the 



transaction in step S16. This includes confirming the 
supplemental audio information selected by the caller as 
well as billing information. If the caller decides not 
to complete the transaction, he or she can simply hang up 
the telephone or start the process over to select 
different supplemental audio information. 

After confirmation, the CPU 21 in step S17 communicates 
the supplemental audio information, which is synchronized 
to the action occurring on the television program 3 0 
using the time-code entered by the caller. This is 
accomplished, as described above, by starting the 
supplemental information using the time-code as an 
offset. The CPU 21 starts playback of the supplemental 
audio information accordingly, based on the entered 
time-code . 

After the call termination (i.e. the supplemental audio 
information is complete or the caller hangs up the 
telephone), the CPU 21 in step S18 updates the caller's 
record in the billing database 26. This record is used to 
track the cost of the call. The actual billing is done 
by the phone company, who, upon receipt of payment from 
the caller, reimburses the service for the cost of the 
content. The service charge information is sent to the 
caller's telephone service provider and appears on the 
caller's monthly or periodic telephone statement. Of 
course, alternate methods of payment may be used instead, 
including credit card transactions, debit cards, or the 
caller could receive a separate bill for each use and pay 
by check or similar means. In these cases, the billing 
database would be used to actually bill the customer 
and/or interact with a credit card company. 

The revenues generated by the service can be distributed 
in a variety of ways among the various persons and 
organizations providing the service (i.e. the TV program 
provider, the 900 service provider, the actors, etc.). 
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FIGS. 10a and 10b are flow charts depicting how the 
service controller processes information received from 
the IVRU 12. In step S19, the CPU 21 receives the ten 
digit alphanumeric string from the IVRU 12. These ten 
digits represent the program identification code which is 
entered by the customer via his or her telephone, as 
discussed above. 

In step S20, the CPU 21 separates the ten digit string as 
follows: the first two digits, the next four digits, and 
the last four digits. As described below, the separated 
strings represent program selection information and 
synchronization information related to the broadcast 
television program 30. 



:l ] The first two digits represent the network identification 

n number for the television program 30. In step S21, the 
CPU 21 searches for a match in the network identification 

t! number field F2 of the network database 2 6a. If no match 

2° is found in step S22, the CPU 21 prompts the customer via 

y the IVRU 12 to reenter the program identification code in 

^ step S23. Otherwise, the CPU 21 continues to step S24. 



The next four digits of the program identification code 
represent the program identification number. In step 
S24, the CPU 21 searches for a match in the program 
identification number field F5 of the program database 
26b. If no match is found in step S25, the CPU 21 
prompts the customer via the IVRU 12 to reenter the 
program identification code in step S26. Otherwise, the 
CPU 21 continues to step S27. 



Alternatively, the program identification code can have 
more than ten digits. This would allow additional 
35 information to be entered by the caller, for example, an 

episode number. The last four digits of the program 
identification code represent the synchronization 
information (i.e the time-code). 



In step S27, the CPU 21 stores the time-code in a new 
record created for the customer in the recording database 
26d. Once the time-code has been received (and 
adjusted) , the CPU updates the time-code at the 
predetermined intervals to ensure proper synchronization 
with the television program 30 is maintained. Other 
information including the program identification number 
and the number dialed by the caller are also stored in 
the new record. 

In an alternative embodiment, the synchronization 
information may be derived by the service controller 2 0 
directly from the television program 30. The user, for 
example, could hold the telephone up to the speaker of 
the television so that the service controller 20 could 
receive the synchronization information. The service 
controller 20 would monitor the audio component of the 
television program 30 and compare it with the 
corresponding audio track (i.e. a duplicate) stored at 
the service controller 20. Using the stored copy, the 
service controller 20 would synchronize the supplemental 
audio information without requiring the customer to enter 
any additional information. 

The CPU 21 accesses the participating characters field F8 
in the program database 26b and transmits the list to the 
caller via the IVRU 12 in step S28. The CPU 21 receives 
from the caller via the IVRU 12 the character selection 
number in step S29. Once again, the caller enters this 
information using his or her telephone keypad. The 
character selection number is a two digit alphanumeric 
string. The CPU 21 receives it and enters it in the 
appropriate field in the recording database 26d in step 
S30. 

In an alternative embodiment, the supplemental audio 
information may be used to offer services such as foreign 
language translations of TV programs and descriptive 
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audio for the blind. 

While the present invention has been described above in 
terms of specific embodiments, it is to be understood 
5 that the invention is not intended to be confined or 

limited to the embodiments disclosed herein. On the 
contrary, the present invention is intended to cover 
various methods, structures and modifications thereof 
included within the spirit and scope of the appended 
10 claims. 
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WHAT IS CLAIMED IS: 

1- A data processing apparatus for providing 
supplemental broadcast information, comprising: 
a CPU; 

a storage device operatively connected to said CPU; 

an apparatus, adapted for communicating with said 
CPU, for receiving a request from a caller over a 
telephone network for supplemental information related to 
a broadcast television program and for relaying the 
request to said CPU; and 

said storage device storing a program, adapted to 
be executed by said CPU, for processing the request for 
supplemental information and for transmitting the 
requested supplemental information through said 
apparatus . 

2. The apparatus according to Claim 1, wherein the 
supplemental information comprises audio information 
recorded on a recording medium. 

3. The apparatus according to Claim 2, wherein said 
information recorded on the recording medium comprises 
supplemental dialogue for a character within the 
broadcast television program. 

4. The apparatus according to Claim 3, wherein a 
playback of said supplemental dialogue does not overlap 
dialogue spoken by any character within the broadcast 
television program. 

5. The apparatus according to Claim 2, wherein said 
storage device contains a database to store the 
supplemental information, and said program stored within 
said storage device is further adapted to perform 
maintenance related to said database. 



6. The apparatus according to Claim 1, wherein the 
supplemental information comprises live audio 
information. 



7. The apparatus according to Claim 1, wherein said 
apparatus comprises an IVRU including a plurality of 
voice messages, and wherein said voice messages are used 
to communicate to, and obtain information from, the 
caller . 



8. The apparatus according to Claim 1, wherein the 
request for supplemental information includes providing 
selection information and synchronization information. 

9. The apparatus according to Claim 8, wherein the 
synchronization information comprises a time-code; and 

said program is further adapted to update said 
time-code at predetermined intervals, and to use said 
time-code to synchronize the supplemental information to 
an audio component of the broadcast television program. 

10. A method for providing supplemental information 
synchronized to a broadcast television program using a 
CPU, and a storage device operatively connected to the 
CPU and containing a program adapted to be executed by 
the CPU for processing a request for supplemental 
information, and an apparatus adapted for communicating 
with the CPU, said method comprising the steps of: 

receiving the request for supplemental information 
from a caller via the apparatus; 

receiving selection information from the caller via 
the apparatus ; 

processing the selection information by having the 
CPU execute the program; 

receiving synchronization information ; 

synchronizing the requested information with to an 
audio component of the broadcast television program using 
the synchronization information; 



communicating the requested information via the 
apparatus . 

11. The method according to Claim 10, further comprising 
the step of updating a database within the storage device 
indicating that the requested supplemental information 
has been communicated in said communicating step. 

12. The method according to Claim 10, further comprising 
the step of requesting payment for the communicated 
supplemental information . 

13. A method for providing entertainment, comprising: 
receiving a request from a requestor for 

supplemental information relating to a television program 
being broadcast at the time of the request; 

processing the request for supplemental information; 

transmitting the requested supplemental information 
to the requestor at times when an audio component of the 
television program and the transmission of the requested 
supplemental information do not conflict with each other. 

14. Computer executable process steps, stored on a 
computer readable medium, for processing requests for 
supplemental information related to a broadcast 
television program, comprising: 

a step to receive a supplemental information request 
via a telephone network interface; 

a step to receive selection information; 

a step to process the selection information ; 

a step to retrieve the requested supplemental 
information ; 

a step to synchronize the requested supplemental 
information to an audio component of the broadcast 
television program; and 

a step to output the synchronized requested 
supplemental information . 



15. The computer executable process according to Claim 
14, further comprising the step of receiving 
synchronisation information related to the broadcast 
television program. 

16. A system, comprising: 

means for broadcasting a television program 
including an audio component and a video component; 

at least one supplemental component for said 
broadcast television program; 

a data processing apparatus including a CPU and a 
storage device operatively connected to said CPU, said 
storage device also containing a program, adapted to be 
executed by said CPU, for receiving a request for said 
supplemental component, processing the request for said 
supplemental component, and providing a playback of the 
requested supplemental component which is time 
synchronized to said audio component of said broadcast 
television program. 

17. The apparatus according to Claim 16, wherein the 
broadcast television program is selected from the group 
consisting of a live broadcast and a prerecorded 
broadcast . 

18. The apparatus according to Claim 16, wherein the 
playback of the requested supplemental information is 
transmitted via a telephone network interface. 

19. The apparatus according to Claim 16, wherein said 
video component of said broadcast television program 
contains synchronization information and selection 
information . 

20. The apparatus according to Claim 19, wherein the 
program is further adapted to receive and process said 
synchronization information . 



21. The apparatus according to Claim 16, wherein the 
program is further adapted to receive the request for 
said supplemental component from a telephone network 
interface . 

22. A method for providing entertainment using a data 
processing apparatus including a CPU and a storage device 
operatively connected to the CPU and containing a program 
adapted to be executed by the CPU for processing a 
request for supplemental information and providing a 
playback of the requested supplemental information, said 
method comprising the steps of: 

broadcasting a television program including an audio 
component and a video component; 

receiving a request for the supplemental information 
related to the television program, where the request 
includes synchronization information; 

processing the request for the supplemental 
information by having the CPU in the data processing 
apparatus execute the program; 

synchronizing the requested supplemental information 
to the audio component of the television program using 
the synchronization information; and 

transmitting the requested supplemental information. 

23. The method according to Claim 22, wherein the 
requested supplemental information is live audio 
information. 

24. The method according to Claim 22, wherein the 
requested supplemental information is prerecorded on a 
recording medium. 

25. The method according to Claim 22, further comprising 
the step of recording on a recording medium the 
supplemental information . 



26. A method for providing visual and audio 



entertainment, comprising the steps of: 

broadcasting a television program including an audio 
component and a video component; 

receiving a request from a requestor for 
supplemental information related to the television 
program; 

processing the request for the supplemental 
information; 

transmitting the requested supplemental information 
to the requestor at times when the audio component of the 
television program and the playback of the requested 
supplemental information do not conflict. 

27. The method according to Claim 26, further comprising 
the step of updating a database indicating that the 
requested supplemental information has been transmitted 
in said transmitted step. 

28. The method according to Claim 26, wherein the 
broadcasting step further comprises broadcasting ordering 
information for the supplemental information. 

29. The method according to Claim 26, wherein the 
broadcasting step further comprises broadcasting 
synchronization information related to the television 
program . 

30. A method according to Claim 29, wherein the step of 
broadcasting the synchronization information further 
comprises broadcasting a time-code that is updated at 
predetermined intervals and which is used to synchronize 
the supplemental information to the television program 
broadcast in said transmitting step. 

31. The method according to Claim 29, wherein the step 
of receiving the request for the supplemental information 
includes receiving the synchronization information from 
the requestor. 



32. A method of receiving supplemental information 
related to a broadcast television program including an 
audio component and an video component, comprising the 
steps of: 

viewing the broadcast television program; 

receiving ordering information for the supplemental 
information from the broadcast television program; 

requesting the supplemental information in 
accordance with the ordering information; 

providing selection information; 

receiving the selected supplemental information 
during the broadcast television program. 

33. A method according to Claim 32, wherein the step of 
receiving ordering information comprises receiving 
program identification information, a telephone number 
used for ordering the supplemental information, and 
synchronization information related to the broadcast 
television program. 

34. A method according to Claim 32, further including 
the step of paying for the supplemental information. 

35. A method according to Claim 34, wherein the step of 
paying for the supplemental information is accomplished 
by a credit card transaction. 

36. A method according to Claim 34, wherein said step of 
paying for the supplemental information is performed 
through a telephone bill. 

37. A method for requesting supplemental information 
related to at least one character within a broadcast 
television program including an audio component and an 
video component, comprising the steps of: 

viewing the broadcast television program; 
requesting supplemental information for the 
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character within the broadcast television program; and 

receiving the requested supplemental information for 
the character synchronized with the audio component of 
the broadcast television program. 

38. A method for preparing supplemental information 
related to at least one character featured on a broadcast 
television program, said method comprising the steps of: 

writing dialogue, not broadcast with the television 
program, for the character featured on the broadcast 
television program; 

recording the additional dialogue on a recording 
medium; 

editing the additional dialogue recorded in said 
recording step such that the audio component of the 
broadcast television program and the edited additional 
dialogue do not conflict with each other when listened to 
s imul taneous ly . 

39. An article, comprising: 

a recording medium having recorded thereon a video 
component and an audio component for transmission to and 
display on at least one display device; and 

synchronization information recorded on said 
recording medium for transmission to and display on at 
least one display device, said synchronization 
information adapted to synchronize supplemental audio 
information not recorded on said recording medium to said 
audio component . 

40 . A signal containing information for requesting 
supplemental audio information relating to program 
information conveyed by the signal, the supplemental 
audio information not being part of the program 
information, comprising : 

a program including a video signal component and an 
audio signal component for transmission to at least one 
display device; and 
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service information included as part of said video 
signal component, said service information including a 
multi-digit code for identifying said program, a 
telephone number to be dialed for requesting the 
supplemental audio information and synchronization 
information for synchronizing the supplemental audio 
information with the said audio signal component of said 
program, 

wherein said synchronization information is updated 
at a predetermined interval . 



ABSTRACT OF THE DISCLOSURE 



An apparatus, method, and program for providing 
supplemental information related to a broadcast 
television program. Through a telephone or electronic 
network interface, a caller can request specific 
supplemental information related to one or more 
characters within the broadcast television program. The 
supplemental information is synchronized to the audio 
component of the television program so that there is no 
conflict, and is communicated to the caller via the 
network interface. 
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Declaration and Power of Attorney For Patent Application 

English Language Declaration 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, 
first and joint inventor (if plural names are listed below) of the subject matter which is claimed and for 
which a patent is sought on the invention entitled 

SYSTEM AND METHOD FOR SUPPLYING SUPPLEMENTAL AUDIO INFORMATION FOR 
BROADCAST TELEVISION PROGRAMS 

,== the specification of which 

m (check one) 

% SI is attached hereto. 

m □ was filed on as United States Application No. or PCT International 

2! Application Number ^_ — 

and was amended on 

□ (if applicable) 

I hereby state that I have reviewed and understand the contents of the above identified specification, 
i ll including the claims, as amended by any amendment referred to above. 

j 9 I acknowledge the duty to disclose to the United States Patent and Trademark Office all information 
known to me to be material to patentability as defined in Title 37, Code of Federal Regulations, 
Section 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, Section 119(a)-(d) or 
Section 365(b) of any foreign application(s) for patent or inventor's certificate, or Section 365(a) of any 
PCT International application which designated at least one country other than the United States, 
listed below and have also identified below, by checking the box, any foreign application for patent or 
inventor's certificate or PCT International application having a filing date before that of the application 
on which priority is claimed. 

Prior Foreign Application(s) Priority Not Claimed 

□ 

(Number) (Country) (Day/Month/Year Filed) 

□ 

(Number) (Country) (Day/Month/Year Filed) 

□ 

(Number) (Country) (Day/Month/Year Filed) 
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I hereby claim the benefit under 35 U.S.C. Section 119(e) of any United States provisional 
application(s) listed below: 



(Application Serial No.) 


(Filing Date) 


(Application Serial No.) 


(Filing Date) 


(Application Serial No.) 


(Filing Date) 



I hereby claim the benefit under 35 U. S. C. Section 120 of any United States application(s), or Section 
365(c) of any PCT International application designating the United States, listed below and, insofar as 
the subject matter of each of the claims of this application is not disclosed in the prior United States or 
PCT International application in the manner provided by the first paragraph of 35 U.S.C. Section 112, 
2 I acknowledge the duty to disclose to the United States Patent and Trademark Office all information 
~ known to me to be material to patentability as defined in Title 37, C. F. R., Section 1.56 which 
j|* became available between the filing date of the prior application and the national or PCT International 
□ filing date of this application: 



08/821,436 March 21, 1997 



(Application Serial No.) 


(Filing Date) 


(Status) 




(patented, pending, abandoned) 


(Application Serial No.) 


(Filing Date) 


(Status) 




(patented, pending, abandoned) 


(Application Serial No.) 


(Filing Date) 


(Status) 




(patented, pending, abandoned) 



I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application or any patent issued thereon. 
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POWER OF ATTORNEY: As a named inventor, I hereby appoint the following attorney(s) and/or 
agent(s) to prosecute this application and transact all business in the Patent and Trademark Office 
connected therewith, (list name and registration number) 




22927 

PATENT TRflDEHARK OFFICE 



Send Correspondence to: 22927 

PATENT TRADEMARK OFFICE 



Direct Telephone Calls to: (name and telephone number) 
Steven M. Santisi (203)461-7127 





Full name of sole or first inventor 
Jay S. WALKER 




Sole or first inventor's signature 


Date 




Residence 

124 Spectacle Lane, Ridgefield, Connecticut 06877 USA 




Citizenship 

United States of America 




Post Office Address 
Same as above 







Fuii name of second inventor, if any 




James A. JORASCH 




Second inventor's signature 


Date 


Residence 




25 Forest Street, Apt. 5G, Stamford, Connecticut 06901 USA 




Citizenship 




United States of America 




Post Office Address 




Same as above 
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Full name of third inventor, if any 
Thomas M. SPARICO 






Third inventor's signature 


Date 






Residence 

200 Broad Street, Apt. 2430, Stamford, Connecticut 06901 






Citizenship 

United States of America 






Post Office Address 
Same as above 
















Full name of fourth inventor, if any 






Fourth inventor's signature 


Date 






Residence 






Citizenship 






Post Office Address 
















Full name of fifth inventor, if any 






Fifth inventor's signature 


Date 






Residence 






Citizenship 






Post Office Address 
















Full name of sixth inventor, if any 






Sixth inventor's signature 


Date 






Residence 






Citizenship 






Post Office Address 
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